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When  learning  new  cognitive  skills  Involving  problem  solving,  novices  are  often  reminded  of 
earlier  problems.  The  use  of  earlier  problems  Is  a  common  means  of  problem  solving  and 
affects  the  learning  of  the  skill.  This  project  has  three  alms  In  understanding  this  leaminc 
First,  the  representation  of  the  resulting  generalizations  Is  being  examined.  Generalization' 
formed  from  remindings  are  likely  to  be  conservative.  In  that  they  may  be  more  tied  to  the 
examples  than  many  current  theories  allow,  A  main  aim  of  the  project  is  to  distinguish  and 
test  different  forms  of  this  conservatism.  Second,  the  develgpment  of  problem  solving 
expertise  Is  examined  by  focusing  on  differences  In  how  typical  and  atypical  problems  are. 
solved.  Third,  the  effects  ’of  such  reminding-based  learning  In  everyday  problem  solving  Is 
exainjned  to  extend  the  findings  and  test  some  theoretical  Ideas  that  are  difficult  to 
Investigate  In  more  formal  domains.  This  report  provides  an  overview  of  this  work  and  the 
progress  on  these  objectives  during  the  last  year. 
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ANNUAL  TECHNICAL  REPORT:  REMINDING-BASED  LEARNING 

In  Ms  annual  report,  I  have  again  repeated  the  ovoview  and  background  needed  to 
understand  the  progr^  made  since  the  last  rqxvt  Aldiough  Ms  strategy  makes  this  report 
partially  redundant  with  die  1993  report,  it  allows  die  reader  to  understand  this  report  widiout 
refening  back  to  die  earlier  report  for  clarificatioi.  I  have  only  included  projects  that  have  bera 
worked  on  in  the  last  year. 


OBJECTIVES 

When  learning  a  new  cogmtive  skill,  novices  ^imd  much  of  dieir  time  solving  problems, 
hi  (kMg  so,  it  is  common  for  novices  to  think  back  to  an  eariier  problem  that  die  currrait  prc^lem 
raninds  them  of  and  use  this  earlier  [nxiblem  to  help  solve  the  current  problem  (e.g.,  Ross,  1984, 
1987, 1989a).  This  use  of  the  earlier  prc^lem  not  only  affects  performance  on  the  current 
problem,  but  also  provides  die  learner  with  additional  knowledge  diat  can  be  accessed  and  used  on 
later  problems.  Ihe  aim  of  this  research  is  to  understand  die  nature  of  die  learning  that  results  horn 
diis  use  of  eaiiier  problems.  Little  is  known  about  diis  cmcial  source  of  learning. 

Such  within-dcxnain  analogies  occur  ffi^ently  during  learning.  In  die  view  presoited  in 
diis  work,  a  gmeralizadon  is  formic  from  making  an  analogy  b^een  problems.  Rather  than 
positing  a  separate  generalization  process  that  operates  upcm  completed  instances,  the 
generalization  may  be  a  byproduct  of  the  analog.  In  using  the  e^er  problem  to  help  solve  die 
current  problem,  comparisons  must  be  made  and  some  aspects  gmeralized  over.  Remindings,  by 
setting  up  the  analogy,  may  determine  what  pairs  of  problenis  are  con^iared  and,  hoice,  what 
generalizations  are  made.  Ihe  learning  conies  about  because,  while  the  noticing  might  be  based  on 
a  variety  of  similar  aspects  (including  superficial  ones)  between  die  problems,  the  compariscms 
forces  the  generalization  of  many  of  die  aspects.  My  earlier  work  (e.g.,  Ross  &  Kennedy,  1990) 
has  shown  that  die  use  of  earlier  problems  allows  novices  to  begin  to  form  goieralizatitms  across 
problems.  Thus,  this  means  of  learning  may  be  one  wav  in  \iMch  novices  can  begin  to  develop 
more  expat-like  knowledge  stmctures.  However,  much  weak  remains  to  be  done  to  understand 
this  learning.  The  research  I  have  beoi  conducting  has  three  goals. 

The  first  goal  is  to  understand  the  nature  of  the  resulting  gaieralizadon,  the  information 
included  in  its  representation.  If  the  generalization  results  fiom  Ihe  reminding,  it  is  litely  to  be  a 
conservative  one,  in  that  it  will  be  somevdiat  tied  to  die  problems  fiom  iivhich  it  arises.  In  fact, 
most  theories  of  learning  assume  some  conservatism,  but  my  research  (a)  distinguishes  among 
different  types  of  assumptions  of  ccxiservatism,  (b)  relates  these  (Ustinctions  to  curroit  dieories, 
and  (c)  tests  these  distincticxis.  Thus,  this  work  examines  the  specificity  of  what  is  learned,  as 
well  as  its  goierality. 

The  second  goal  of  diis  research  is  to  examine  die  implicaticns  of  diese  ideas  for  the 
development  of  expertise.  Research  on  expertise  in  madiematics  and  i^ysical  science  domains 
suggests  diat  experts  have  problem  schemas  duit  allow  them  to  categorize  problems,  as  well  as 
associated  procedures  for  solving  problems  of  that  type  (e.g.,  Chi,  Feltovich,  &  Glaser,  1981). 
Despite  die  importance  of  these  schemas,  little  research  examines  how  they  are  learned.  A 
ctxnmon  idea  is  diat  they  may  develqi  from  the  con^iarisoo  of  problems.  However,  this  idea  leads 
to  two  ^estions?  One,  how  do  people  know  which  problems  to  compare?  Two,  why  are  peqple 
comparing  problems  (Le.,  what  is  die  nature  of  this  con^arism)?  The  reminding-based  learning 
view  sugge^  that  pec^le  compare  problems  when  one  makes  Mm  think  back  to  another  and  they 
do  so  in  order  to  use  the  earlier  one  to  solve  the  current  problem.  In  addition,  this  view  suggests 
that  people  may  develop  problem  schemas  that  ate  influenced  by  the  superficial  aspects,  because 
diese  aspects  are  known  to  affect  remindings.  Thus,  part  of  this  project  is  concerned  with  the 
develqnnait  of  such  problem  schemas  and  die  possibility  diat  some  schemas  may  critically  depend 
upcxi  superficial  contents,  even  in  experts. 
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The  tfiird  goal  of  tfiis  project  is  to  begin  to  extoid  this  woric  to  moce  eveiyday  problem 
sdving  situatkms.  This  extmsion  will  not  only  allow  the  ^licaticn  and  test  of  these  ideas  in  an 
important  new  setting,  it  will  also  force  the  extensicn  of  this  work  to  important  situations  diat  are 
hard  to  experiment  with  in  mote  formal  domains. 


STATUS  OF  PROJECTS 


In  diis  section,  I  will  provide  s(xne  details  of  the  status  of  the  projects  underway.  For  each 
goal,  I  will  first  give  a  biitf  summary  of  the  findings  and  dien  provide  fi^er  details. 

1.  Conservatism  of  learning 

As  described  eariier,  this  project  examines  die  representation  of  die  resulting  goieralization. 
The  focus  Ixae  has  beoi  on  asking  how  the  problem  sdlving  affects  \i1iat  gets  incorporated  into  die 
genoalization  and  die  effect  on  later  performance. 

Summary.  One  project  has  been  examining  how  die  representadon  of  the  generalizaticn 
may  depmd  upon  the  A-toils  of  how  die  earlier  problem  is  used.  The  early  work  in  this  project, 
reported  last  year,  has  not  only  led  to  further  research  along  die  same  lines,  but  has  also  spawned  a 
radier  different  iqiproach  to  pi^lem  categorization.  A  second  project  investigates  the  interacticns 
among  die  differrat  processes  involved  in  reminding,  analogic^  transfer,  and  generalization. 

la.  The  effect  of  problem  use  on  di<--  pwiftralizarifin.  In  addition  to  testing  the  conservatism 
of  the  generalization  in  die  way  described  above,  a  central  idea  of  die  reminding-based  view  is  that 
die  generalization  depends  upon  die  earlier  problem  comparison.  This  selectivity  effect  has  be^ 
investigated  me  in  the  context  of  category  learning  ^oss,  Peikins,  &  Tenpepy,  1990), 
because  in  foc^  domains  different  earlier  pdblems  will  ofien  lead  to  very  similar  generalizations. 
However,  in  diis  study  I  examine  vdiedier  Ae  details  of  h^  the  problem  is  used  (rather  dian 
vihich  i^lem)  affects  what  is  learned.  As  will  be  seen,  it  can  be  viewed  as  a  ty^  of  transfer- 
appropriate  processingin  problon  solving.  In  (i),  I  report  on  some  earlia-  work  and  the  extoisions 
in  die  last  year.  In  (ii),  I  report  on  a  new  project  that  approaches  diis  general  idea  fiom  a  differmt 
perspective  and  the  initial  results  of  scmie  experimrats. 


(i).  Problem  categarizcftion:  The  basic  paradigm  for  mcamining  die  effect  of  using  an 
earlio*  pr^lem  is  referred  to  as  Ae  oiing  method.  The  typcal  experiment  involves  study 
examples,  first  test  problems  (with  cues  to  the  stucfy  exai^les),  and  second  test  problems.  This 
simple  case  allows  us  to  isdate  the  specific  influoices  aa  each  test  and  to  detail  the  kami^  on  a 
stqi-l^-step  level  More  specifically,  subjects  are  instructed  in  a  sin^ilified  formal  dcanain, 
elemoitary  probability  theory.  They  are  given  a  short  introductimi  to  smne  probability  concepts 
and  then  learn  four  principles  (e.g.,  pemutations).  For  each  princqile,  an  explanation  of  die 
piinc4>le  the  i^ipropriate  formula  is  given.  The  subject  then  he4>s  to  sdve  a  word  problem 
diat  requires  die  use  of  die  principle.  This  study  problem  is  presented  in  a  workbook  format,  with 
die  subjects  guided  dirough  the  sdution.  After  learning  diese  principles  (4  mins/princ4>le), 
subjects  are  given  first  test  problems  to  solve  (3  mins).  In  many  of  die  studies,  some  or  all  of 
these  first  test  problems  include  a  cue  (e.g.,  "this  is  like  the  earli^  golf  problem"),  Miidi  has  hcea 
shown  to  result  in  a  graeralization  (Ross  &  Kennedy,  1990).  After  each  prcblem,  feedback  is 
given  and  subjects  study  the  soluticm.  A  second  test  is  thra  given.  Of  main  interest  is  poformance 
on  the  second  test  problem  as  a  function  of  die  experimoital  manipulatirm.  In  all  of  these 
eiqieriments,  principles  are  rotated  through  axiditiais  and  sevmal  test  examples  are  used  for  each 
principle  to  avoid  effects  due  to  any  particular  example. 

The  earliest  studies  using  the  cuing  paradigm  showed  that  cuing  on  the  first  test  led  to 
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unproved  peifarmance  on  the  second  test  in  three  ways:  better  problem  solving  performance, 
hi^er  prcAxibility  of  accessing  the  appropriate  fcxmula,  and  better  instantiation  of  a  provided 
formula  (Ross  &  Kennedy,  1990,  Eu.  1  and  2).  After  ccmducting  these  studies,  I  also  became 
interested  in  problem  categorization,  vdtich  is  thought  to  be  a  crucial  eip-mftnt  in  developing 
npertise.  Thus,  I  used  tiie  cuing  paradigm  but  instead  of  a  second  test  problem,  subjects  were 
givoi  12  problems  (3  of  radi  principle)  and  asked  to  categorize  them  by  pruic4>le.  That  is,  at  the 
first  test,  half  of  tire  principles  were  cued  and  half  were  not  If  cuing  affects  problem 
categorization,  thoi  higher  categorization  should  occur  for  the  cued  principles.  In  one  study,  I 
gave  tiiem  formulae  to  use  as  the  categories  for  sorting  and  in  anoOier  I  gave  them  the  principle 
names.  The  (unexpectetQ  result  was  that  tiie  cuing  had  no  effect 

hi  an  earlier  annual  rep^  I  rqxnted  a  study  that  investigated  (me  difference  beftv^era  the 
cue  method  and  tiie  usual  way  in  \Kdiich  people  tiiink  of  earlier  i^lems.  Usually  when  people  are 
reminded  tiiey  need  to  ^ide  \^ether  the  reminding  is  qiprc^iriate.  That  is,  tiiey  n^  to  decide 
ydiether  to  use  the  reminciing  or  not,  since  we  often  get  reminded  of  earlier  problems  for 
inappropriate  reasons.  This  difference  may  be  crucial  because  a  detenninatioi  of  appropriateness 
may  include  deciding  whetiier  the  problems  are  of  tiie  same  "type"  so  that  one  could  be  used  to 
help  setive  anotiier.  Thus,  such  a  determinatiem  might  affect  \(hat  is  learned  alxmt  problem 
categories. 

The  stuefy  used  tiie  same  procedure  and  materials  that  led  to  no  cuing  effect  and  madft  one 
change.  On  the  [xinc4>lcs  tiiat  subjects  are  cnied,  tiiey  are  told  tiiere  is  a  chance  that  tiiese  cues  are 
notcorrect  Their  task  is  to  first  d^ide  if  the  cue  is  (xsiect  or  not  Th^  are  then  given  feedback 
on  tiiis  response  md  ^ven  Ae  correct  cue.  In  fact,  all  the  cues  are  correct  so  they  are  givra  exactly 
tiie  same  (nies  as  in  tiie  earlier  study,  but  tiiey  have  to  detmnme  appn^jiiateness  before  »»ing  the 
cued  problem.  The  results  in  tiiis  case  shoiK^  an  effect  of  cuing,  witii  tiie  cued  principles  leading 
to  .47  of  tiie  second  test  problems  being  correctly  categorized  compared  to  30  for  the  not  cued 
principles,  t(29)- 2.17. 

In  my  last  rep^  I  mentioned  a  replicatiem  of  this  vriiich  also  included  tile  usual  cues.  The 
results  were  encoura^g:  the  probabilistic  cue  subjects  showed  a  small,  but  consistent  and 
significant  effect  of  cuing,  .47  vs.  .40,  t(47)-2.77.  The  subjects  receiving  the  usual  cues,  showed 
a  slight,  nonsignificant,  effect  in  the  other  direction,  .413  vs.  .455. 

In  the  last  year,  my  graduate  RA,  Matthew  Kilbane,  and  I  have  replicated  this  result  for  the 
probabilistic  cue  subjects  (.48  vs.  .43).  Our  next  experiment,  which  is  in  progress,  attempts  to 
provide  a  deeeper  understanding  of  tiie  reas(m  for  tiie  imiblem  similarity  by  providing  a  furtiier 
description  of  each  test  problem  (tiirased  in  a  way  to  higW^t  tiie  relevant  information.  The  point 
of  tiiis  manipulation  is  to  ask  whether  the  cuing  to  an  earlier  problem  silows  people  to  maifft  evm 
better  use  of  tiiis  relevant  inforn^on.  We  have  two  motivations  for  tiiis  manipiifitif«  change. 
I^rst,  we  wanted  to  show  that  this  probabilistic  cue  effect  can  cxxnir  evoi  when  the  unc^ueri 
concUtions  lead  to  hi^er  pefformance.  Second,  and  most  importantly,  we  tiiink  this  manipulaticxn 
will  luve  iinportant  implications  for  how  complex  problem  categories  might  best  be  instructed. 

That  is,  while  the  cuing  helped  performance  in  our  earlier  expoiment,  the  effect  on  problem 
categorization  was  smalL  Our  analysis  suggested  that  what  was  needed  al(xig  with  the  comparison 
was  some  way  of  pointing  leamoa  to  the  reason  bdiind  the  problem  similarity,  which  is  what  we 
are  trying  to  do  witii  the  current  cues.  Assuming  it  works,  we  will  have  g(xxi  evidmee  tiiat  how 
the  earlier  problem  is  used  affects  what  is  learned. 

(ii)  Prcblem  categorization  as  a  function  of  problem  use.  One  new  project  begun  tiiis  year 
came  out  of  the  ideas  for  tiie  problem  categorization  study.  First,  the  work  in  pt^lem  solving 
suggests  that  problem  categorization  is  among  the  most  crucial  aspects  of  prcblem  solving  and  one 
of  the  most  diffi^t  to  learn.  (One  way  to  think  about  this  is  u»  toms  of  the  applicability 
conditions  used  in  production  systems,  which  most  computation^  mcxielers  have  argu^  is  the 
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^ghest  pan  of  getting  die  systems  to  work).  Sectxid,  die  work  in  categoiizaticxi  focuses  on  the 
instances  t^g  categcnzed  as  if  die  goal  was  to  know  die  categoiy  rafter  than  use  fte  categoiy  to 
do  sranedimg  with  fte  instance  (e.g.,  make  a  pr^ction,  inference,  etc.)-  ^  this  project,  I  take  fte 
problem  serving  perspective  and  try  to  combine  it  with  the  project  mentioned  in  (i)  to  show  how 
die  instances  are  used  affects  what  is  learned  about  fte  category.  My  preUminary  work  (m  this 
uses  simple  algebra  equations  and  contrasts  is  learned  about  fte  categories  in  terms  of  fte 

effect  on  later  categorization  of  more  complex  instances.  I  will  mention  two  results  showing  this 
type  of  effect  to  make  clearer  fte  idea  and  directions  I  hope  ft  take  it 

(iia)  Contrasting  cat^orization  and  use.  I  used  two  simple  types  of  algebra  equations  that 
differ  in  terms  of  the  order  of  die  operations  used  ft  solve  diem.  For  examine,  a  +  (bx/c)  -  p  can 
be  s(dved  for  x  by  subtracting  a,  mulitylying  by  c,  and  dividing  by  b,  which  I  shall  call  SMD  (for 
diis  esqieiiment  it  does  not  matter  if  di^  go  SDM  instead).  A  second  equation  type,  for  example, 
(q+  mxVb  -  s,  can  be  solved  by  multiply,  subtracting,  then  dividing  (MSD).  In  addition,  I 
confounded  srane  mathematically  inlevant  properties  wift  each  type,  sueft  as  fte  letters  likely  ft  be 
used  as  constants  (early  in  fte  alphabet  vs.  late)  and  fte  paienfteses  (^tftefter  it  excluded  part  of 
tfaesumornot).  Two  groups  learned  to  categorize  these  equations  as  type  1  or  type  2.  Qnegroup 
sinqily  categorized  than  and  were  given  fsedback.  The  second  group  also  had  ft  solve  fte 
equations  for  x.  The  results  show  that  both  groups  are  excelloit  at  categorizing  new  instances  like 
die  study  ones,  but  fte  question  of  interest  is  ^riiat  h^pens  uften  fte  test  itons  separate  out  fte 
effects  of  operations,  letters,  and  parendieses.  The  simple  story  is  diat  fte  solving  group  is  much 
more  likely  ft  choose  on  fte  basis  of  tolerations,  ^ftile  fte  categorization  alone  group  is  more 
gready  drawn  by  fte  mathematically  irrelevant  propenies.  Aldiou^  this  may  not  seem  like  a 
surging  result,  the  point  ft  ronembar  is  that  (1)  diese  were  very  sin^ile  equatiems  for  which  all 
subjects  had  much  experience  and  fte  two  types  had  obvious  differences  and  (2)  it  demraistrates 
die  inoiortance  of  fte  use  in  learning  fte  prcftlem  categories. 

(iib)  Different  uses  lead  ft  different  goieializations.  One  difficulty  wift  diis  first 

cxperimoit  is  ftat  it  is  hard  ft  tide  out  a  siniple  boter  learning  explanation  for  fte  peaformance  of 
die  sdving  group.  So,  in  the  second  experiment,  two  groups  sedved  fte  problems  differoitly  and 
ended  up  with  cotiespcxiding  differences  in  their  understanding  of  fte  pr^lem  categories.  In 
particular,  I  added  in  ay  variable,  such  as  in  fte  equation  9  +  sx/t  -  (5qy  +  b) /f.  Qnegroup 
solved  for  x  (making  it  SMD),  while  die  ofter  group  solved  for  y  (making  it  MSD).  The  other 
types  of  equations  were  MSD  for  die  x  group  and  SMD  for  fte  y  group.  Thus,  though  they  saw 
^  same  equations  and  categorized  them  in  die  same  way  at  stucty  (i.e.,  fte  equatim  givoi  was 
called  T>pe  1  by  both  gioui»),  are  predicted  ft  be  teaming  voy  differoit  diings  about  what 

diaracterizes  each  type.  This  prediction  was  confirmed  by  85%  of  the  test  items  (in  which  fte 
variable  z  was  used). 

These  orpoiments  provide  an  inqiortant  direction  on  my  work  on  problem  categorization 
for  two  reasons.  First,  they  provide  a  way  of  examining  more  directly  fte  selectivity  issue,  how 
the  use  of  fte  problems  affect  what  is  learned  from  diem,  an  idea  of  inqxntance  for  both  theoretical 
and  instmetio^  reasons.  Second,  they  provide  an  inqportant  bridge  betweoi  fte  huge  amount  of 
work  on  categorization  ft  fte  much  smaller  body  of  work  on  [nobtem  categorization. 


lb.  Interactions  among  diffemnt  processes.  The  woric  on  selectivity  can  be  viewed  in  a 
riighdy  differoit  way  -  fte  gaieralization  depends  upon  fte  details  of  fte  [^tem  solving.  This 
idea  has  ted  me  to  go  back  and  consider  in  much  mote  detail  how  fte  different  processes  involved 
in  reminding,  plication,  and  generalization  may  be  interacting.  As  I  moitiraied  in  last  year’s 
report,  the  first  smdies  I  conducted  in  diis  project  are  in  coUaboratirai  wift  Prof.  Gary  Bradshaw,  a 
faculty  memba  at  University  of  Colorado  who  is  now  permanently  at  Illinois  We  have  focused  on 
remii^gs  and  transfer.  All  currait  views  of  analogical  problem  solving  (including  my  own) 
assume  fte  new  (target)  problem  is  repiesaited  and  that  diis  representation  leads  to  a  retrieval  of 
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8(xne  eailier  problem  (which  is  dien  mapped  and  transfeired  to  the  new  target  problem).  However, 
dieie  is  also  evidence  that  peq>le  may  be  reminded  during  the  reading  of  a  problem. 

Our  studies  examine  whether  such  remindings  of  earlier  problems  may  mean  that  the  target 
problem's  representaticxi  is  affected  by  the  reminding.  The  importance  of  this  point  is  that  much  of 
the  focus  on  mailing  as  a  sq)arate  pto(^  may  be  misplaced,  IF  the  earlier  problem  is  affecting 
how  the  target  i^lem  is  represoited  (ie.,  much  of  the  transfer  occurs  DURING  the  target  being 
repre^ted,  not  between  die  represent^  t^et  and  the  earlier  problem).  So,  if  this  problem  makes 
me  diink  of  an  earlier  one,  1  may  fit  the  current  problem  to  the  earlier  one.  Bradshaw  and  I  have 
begun  to  test  this  idea  in  a  graeral  way,  using  how  simple  stories  are  interpreted.  Our  results  have 
beia  encomaging:  we  find  a  simple  cue  (a  prc^  name)  reminds  people  of  an  earlier  story  and 
affects  their  interpretation  of  die  current  one.  In  addition,  we  find  diat  this  is  an  encoding  effect  in 
that  one  can  see  Ae  effect  (xi  sentence-by-sentence  reading  times. 

Last  I  reported  that  we  had  just  wiittai  diis  work  up  and  submitted  it  as  a  paper  to  the 

Cognitive  Science  Qmference.  Not  only  was  it  accepted  there,  but  a  more  extensive  write-up  has 
beoi  accepted  for  publicadcm  in  Memory  &  Cognition  (unusually,  with  suggestions  for  only  minor 
changes,  which  have  been  dcme).  After  these  goieral  interpretation  effects,  we  will  now  begin  to 
lode  at  how  the  particulars  of  the  t^et  represoitaticm  may  be  affected  by  the  reminding.  I  am 
quite  excited  by  this  project  and  think  it  be  an  impextant  addition  to  our  understanding  of  die 

reminding  effects  on  problem  solving  and  learning. 


2.  Hie  development  of  problem  solving  expertise 

As  discussed  earli^,  reminding-based  learning  provides  one  perspective  (xi  the  nature  of 
problem  schemas  and  their  developmrat  The  work  alr^y  discussed  can  be  viewed  as  very  early 
precursors  to  problem  schemas,  but  no  evidence  has  yet  been  presented  that  in  fact  they  do  lead  to 
problem  schemas. 

My  focus  has  been  on  the  specialized  schemas  that  often  include  superficial  information  as 
well.  To  study  this,  I  have  written  a  number  of  algebra  word  problems  (e.g.,  distance,  interest, 
mixture).  Each  problem  has  two  versions:  one  wi£  appropriate  (typical)  cemtents  and  one  with 
neutral  ctmtents.  To  make  clear  the  advances  in  diis  ^j^  I  need  to  review  the  earlier  work  I 
reported  in  last  year’s  progress  report  The  first  two  studies  conducted  have  followed  up 
observations  noted  in  a  chapter  a  number  of  years  ago  (Hinsley,  Hayes,  &  Simon,  1977).  First 
we  have  protocols  of  subjects  solving  tiiese  i^lems  in  order  to  ask  how  tiiey  might  differentially 
solve  the  apprx^niate  and  neutral  p^lems.  Hinsley  et  al.  argued  that  the  af^priate  ones  were 
solved  by  schema  instantiation,  while  the  others  were  solved  by  translating  each  sentence  to  an 
equaticxi.  Hiis  result  is  quite  important  but  their  results  were  based  (xr  few  observations  and  no 
^antitative  data  were  provided.  However,  we  were  unable  to  replicate  this  finding,  not  because  it 
is  incorrect  but  because  so  few  of  the  problems  were  solved  at  all  (less  than  50%),  making  it 
impossible  to  see  differences  between  conditions.  We  ctxisidered  several  training  studies,  but 
op^  for  what  I  think  will  be  a  more  fruitfiil  tack.  An  honors  student  Steven  Blessing  (now  at 
Gamegie-Mellon,  working  witii  John  Anderson),  has  redone  this  experiment  with  three  major 
changes.  First  we  have  used  high  math  students  (U1  students  who  graduated  from  a  math  and 
science  academy).  Secemd,  he  has  included  a  set  ^  inappre^ate  p^lems  as  well,  that  is 
I^lems  of  a  given  type  vwth  the  story  cemtents  of  a  diffoent  type.  Third,  we  have  examined  the 
time  and  proportion  correct  Our  findmg  is  that  the  appropriate  and  neutral  conditions  do  not 
differ,  but  they  are  both  more  accurate  and  faster  than  tire  inappropriate  condition.  In  addition,  he 
has  collected  problem  solving  protocols  from  another  group  of  subjects. 

In  the  second  study  ori^ally  conducted,  other  subjects  received  the  same  problems  are 
clause  at  a  time  and  were  required  after  each  clause  to  say  what  type  of  problem  it  is.  Hinsley  et  al. 
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showed  pec^le  could  do  this  quite  readily.  Our  interest  is  in  asldng  how  diis  measure  may  differ 
for  2q)prc^niate  and  neutral  contoits.  The  appropriate  problems  are  categorized  much  earlier. 

We  conducted  several  other  studies.  First,  the  high  math  subjects  woe  tested  in  the  clause 
study  with  apprc^niate,  neutral,  and  inapprcpiate  problems.  We  found  that  the  tq)propriate  wrae 
categorized  fEtster  than  die  neutral  (as  b^ore)  and  the  inaipopiiate  were  categori^  dower  than 
the  neutral  Ihe  inapptqmate  (xntents  o&ea  lead  to  subj^  initially  making  die  (contoit- 
iqipropriate)  iiuqipn^iriate  categorizadtm,  before  "sedng"  die  right  category.  Second,  the  regular 
subje^  (Le.,  UI  students  not  from  die  math  academy)  partidpaled  in  the  timed  [noblem  solving 
task.  We  found  die  same  results  as  with  the  academy  smdrats  (though  the  maans  were  lower). 
To^dier,  these  studies  provide  impoitant  informadcm  about  tte  problem  schemas  and  their  use, 
particularly  cooceming  the  indusion  and  use  of  superficial  aqiec^  Our  current  hypcdiesis  is  that 
die  usual  or  apprqniate  contents  allow  one  to  more  quicldy  categorize  problems  (le.,  the  clause 
result),  but  that  evra  neutral  problems  are  generally  categorized  conecdy  1^  die  end  of  die  {noblem 
(anotto  result  fixxn  the  clause  stutfy).  Hii^  there  is  lit&  accupcy  or  latency  difference  in 
problem  solving  betwem  these  two  conditions.  However,  die  inappropriate  problems  are  more 
difficult  to  categorize  and  die  categorization  is  often  uncertain  even  a&a  die  pn:bkm  has  been  read. 

However,  we  had  not  seoi  any  evidoice  that  die  ai^iropriate  materials  provide  any  ben^t 
to  how  die  problem  is  solved.  Because  our  hypothesis  is  &at  for  Aese  single  problems,  the 
schema  is  recognized  by  the  end  of  the  reading  evm  for  the  neutrals,  we  wanted  sdne 
manipulation  in  i^ch  die  sdiema  might  provide  some  boiefit  if  it  were  recognized  early.  We 
decided  to  use  more  complex  problems,  in  which  we  added  irrelevant  informatkm.  The  idea  is  diat 
if  die  solver  has  die  tqiprc^iriate  schema,  s/he  may  be  better  able  to  decide  on  die  rdevance  of  the 
diffemit  informaticxi  in  the  problem.  This  manipulation  was  quite  successful  First,  a  group  of 
die  academy  subjects  were  faster  and  mote  accurate  in  solving  die  tq^ropriate  problems  versus  the 
neutral  problems  (the  first  time  this  difference  has  come  out).  Secon^  Blessing  expected  smne 
protoeds  and  found  diat  the  apprrqxiate  problems  kd  to  subjects  talking  mote  about  relevant 
information  conqia^  to  the  neutral  problems  (le.,  a  higher  pcqxxtiai  of  the  protocol  statements 
concerned  information  that  was  relevant  to  the  problem  solutim). 

We  were  encouraged  by  these  findings  and  believe  diat  they  may  allow  us  to  see  some 
benefit  of  the  contrat  on  how  the  problem  is  solved  (not  just  on  how  the  schema  may  be  accessed). 
Last  year,  I  moitioned  that  a  likely  possibility  for  the  next  step  was  to  get  protocols  fixxn  some  real 
eiqieits  (algebra  teachers)  and  examine  them  for  whedier  the  contents  are  us^  diroughout  tte 
pr^lem  solving.  That  is  what  I  did,  testing  the  experts  widi  the  same  conqilex  problems  used 
earlier.  The  resiilts  were  quite  interesting.  First,  showing  us  they  were  experts,  all  die  problems 
were  solved  correedy.  Second,  when  the  protocols  were  examined  for  die  sensitivity  to  die 
relevance  of  die  information,  we  found  exrurtly  the  same  pattern  as  with  the  «rperienced  subjects. 
Third,  the  protocols  su^ested  (though  only  suggested)  that  the  solution  of  the  jncblem  was 
affected  by  the  content  in  its  details.  For  examine,  oie  subject  solving  a  neutral  problem  (about  a 
boy  gmng  up  and  down  a  down  escalator)  actually  aided  up  talking  about  it  as  if  it  had  the  contents 
^ically  associated  with  problems  of  this  type  (a  river  curroit  problem  in  which  a  boat  goes  down 
river  with  die  current  and  then  uprivo'  against  the  curroit). 

As  a  whole,  these  experimoits  provide  die  clearest  evidoice  for  the  effect  of  problem 
content  on  die  performance  of  expedmeed  problem  solvers.  We  have  just  submitted  a  prqier  based 
on  these  results  to  the  Gignitive  Scioice  Conference  and  are  about  to  submit  a  more  extoisive 
version  for  publication. 

3.  Everyday  problem  solving 

hi  addition  to  the  work  on  probability  theoty  and  fnmal  domains,  I  have  been  examining 
how  remindings  may  be  used  in  less  formal  situations.  In  particular,  I  have  been  examining  how 
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they  may  affect  Ae  simple  categcries  tfiat  aie  learned.  I  view  this  work  as  parallel  to  the  problem 
soiving  work,  but  it  sometimes  allows  me  to  mote  cleanly  inves^ate  certain  issues,  especially 
selectivity  effects  (Ross,  Perkins,  &  Ten[«nny,  1990).  In  addition,  I  have  bear  tal^g  this  work 
fiitdier  (and  relating  it  to  the  category  use  ideas  menticmed  in  laii)  to  examine  how  cathodes  are 
used  in  making  pr^cticms. 


Summary.  Two  main  projects  have  be&n  ctmducted  under  Ms  idea.  First,  Me  work  on 
reminding-based  generalizations  in  cat^otizadon  has  br^rii  conpleted  and  accepted  for  publication. 
I  provided  a  greatly  detailed  review  of  Mis  in  last  year*.',  report  and  have  salt  in  Me  preprint  of  this 
ivoik,  so  I  will  only  provide  a  short  summary  of  Me  idea  in  3a.  The  second  project  is  also 
investigating  Me  use  of  categories,  wiM  a  focus  on  how  categories  may  be  ukd  for  predicticn. 
AlMough  this  is  a  little  more  tangaitial  to  Me  reminding-based  learning  work,  it  blends  in  nicely 
wiM  Me  effects  of  categoty  use  on  learning  (laii)  and  a^  provides  a  more  detailed  assessmoit  of 
how  Me  categories  are  being  used  in  a  complex  situation. 


3a.  Remindinf  based  generaliratinns  in  cAtegrtriTatim.  Ihe  work  from  Me  last  three  years 
(wiM  a  graduate  studoit  RA,  Tom  Spalding)  has  extended  my  eariier  work  to  show  (1)  that 
reminding-based  goieralizations  occur  in  a  common  categorizatioo  study  paradigm,  (2)  that 
remindings  serve  to  focus  Me  learner  on  to  relevant  features,  (3)  that  Mese  manipulations  lead  to 
differoices  in  perceived  frequency,  (4)  Mat  Mey  also  affect  pile's  prediction  of  Me  values 
for  missing  features,  and  (5)  Mat  Me  effects  of  early  focus  features  affects  vMat  is  learned  from 
later  instances.  I  believe  that  this  idea  may  help  to  prcmde  one  means  by  which  categories  can  be 
learned  and  help  relate  such  learning  to  p^ormance  issues.  In  addition  to  a  ch^)ter  based  on  Mese 
ideas  (Ross  &  Spalding,  1991),  SpaltMig  and  I  have  just  had  a  paper  on  this  accepted  in  Journal  of 
Experimental  Psychology:  Learning,  Memory,  and  Cognition  (Spalding  &  Ross,  in  pness)  and 
have  presoited  this  wo^  at  MPA,  Psychonomics,  and  APS.  I  gave  a  d^iled  rep^  this  in  last 
year’s  prepress  report  and  will  not  repeat  it  here  because  we  have  mainly  woiked  on  tying  up  loose 
Olds  in  Mis  proj^  for  publication  in  Me  last  year.  Again,  Me  motivation  is  to  bring  Me  category 
work  to  bear  oa  issues  we  have  been  examining  in  Me  pr^lem  solving  domain.  For  example, 
problem  categexies  (as  discussed  in  section  2  of  Mis  r^ort)  are  viewed  as  essoitial  in  probtem 
solving,  but  it  is  not  oiough  to  cat^orize  a  problem.  One  must  Moi  use  Me  associated  procedures 
for  solving  the  problem.  Similarly,  within  Me  ctxicept  learning  woric,  we  are  going  beyemd  Me 
questi(»  how  an  instance  is  categorized  to  investigate  how  Me  categorization  is  used.  These 
studies  add  not  only  to  Me  idea  of  reminding-based  learning,  but  also  to  how  categories  might  be 
learned. 


3b.  Predictions  from  uncertain  cateeorizatioos.  My  current  work,  along  wiM  a  facutly 
member  here,  Gregory  Mur|My,  has  takoi  Me  ideas  about  Me  use  of  categories  and  examined  it 
more  directly  in  how  Me  categories  are  used  to  make  judgmoits.  The  next  direction  in  this  work  is 
to  extoid  it  to  simple  problem  solving  situations.  In  many  situations  in  \Mich  peqrle  need  to  make 
a  [xediction  or  judgment  about  an  object,  it  is  assumed  thM  Mey  access  Me  categoty  informatiem 
about  Me  object  and  use  t^  altmg  wiM  any  specific  knowledge  Mey  rrught  have  about  Me  object, 
to  make  Me  prediction  or  judgmoit  However,  ofroi  Me  categories  are  not  certain,  but  raMer 
peqple  have  only  a  likely  category.  An  animal  seen  briefly  is  probably  a  cat,  but  it  could  be  a  dog 
or  raccoon.  How  do  people  use  Mis  uncertainty  in  making  pr^cticxis? 

Our  work  (xi  this  project  has  been  very  extorsive  and  is  included  in  an  1  l-experiment  paper 
I  sent  in  a  few  mcxiMs  ago  Mat  is  to  be  publiMed  in  Cognitive  Psychology.  Here,  I  will  give  (xily 
a  shot  sununary  and  Me  directioi  tiiis  inject  has  taken.  The  shot  summary  is  Mat  in  many 
situations  peqrle  essentially  ignore  Me  probabilistic  nature  of  Me  categorization  and  act  as  if  it  were 
certain.  That  is,  Me  likelihood  of  Me  alternative  categories  has  little  influence  on  Me  judgment, 
under  a  variety  of  situations  Mat  were  used  to  try  to  &d  such  an  influence.  We  Mink  Mis  lack  of 
influence  derives  from  a  heuristic  ogaruzation  of  prediction  brought  about  by  basic  information 
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processing  limitations  (i.e.,  considering  alternatives  is  too  difficult  in  most  situations).  We  thought 
tiiat  tile  use  of  alternative  categories  in  prediction  might  occur  witii  more  naturalistic  situations 
(Malt,  Ross,  &  Murj^y,  under  review  at  but  we  still  found  lit^  influence.  Our 

current  work  (Ross  &  Murphy,  in  progress)  addres^  more  extraisiveiy  tiie  situations  under  \riiich 
one  might  be  able  to  find  such  an  i^uence.  If  the  alternatives  are  brought  to  mind  at  the  time  of 
prediction,  either  explicitly  or  by  the  nature  of  tiie  prediction  judgment,  tiien  some  influaice  is 
found.  Tl^  project  has  b^n  inqiortant  for  my  piwlem  solving  work  as  well,  both  in  forcing  me 
to  think  more  concretely  about  how  various  categories  may  be  used  and  also  in  considering  tiie 
limits  of  informatioi  processing  more  directly  in  the  learning  process. 


General  Summary 

I  have  pesented  a  brief  summary  of  tiie  results  frcmi  the  projects  addressing  the  three 
obj^ves.  As  is  evidoit,  my  woric  continues  to  address  each  of  tiiese  objectives.  I  have  tried  to 
outline  for  each  where  I  see  the  work  going  in  the  i^xt  year.  The  projects  that  seem  most  ripe  for 
advances  are  the  problem  categorization  woric  (lai),  tiie  wcnk  on  category  use  (laii),  tiie  interaction 
among  processes  (lb),  and  tiie  predictions  from  categories  (3b).  The  woric  m  problem  solving 
experti^  (2)  has  gone  well,  but  is  being  finished  up,  as  is  the  woric  on  reminding-based  learning  in 
categorization  (3a). 
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